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A,t ^j^ 


^nput de\dj::^afor control signals for gpntroHingj^^ an^ 
ob1ectLj;ei3j:esfeDt0d^^^^ device and^aohlc display having 

said inputidejyice 

5 The present invention refers to an input device for control signals for controlling 
the movement of an object represented on a display device and to a display 
device^ the representation of wh5ch is controlled by a control signal input device. 

y Control signal Input devices are known, e.g.. In the form of mouse devices. 

1^ Using such Input devices one may control and influence, for example, the 

y. cursor movement on a monitor or - in case of a user program - for example, 

JJ the representation on a display device, e.g, a monitor. It would be advantageous 

51 in a plurality of applications to have representation-specific input devices 

52 available that, dueto their structure, make tteasierfbr a user to readily control 
representations, in parUcular steneographic representations, on a display device, 

H e*q. a monitor. 

From US-A-5 734 370, an input device for a display device is known, with 
which an object may be displaced on the display device. The known Input 

20 device comprises a rod that can be pivoted within the housing of the Input 
device about two mutually parallel axes and can be displaced about its 
longitudinal axis. The known Input device serves to control a virtual pool 
application. Further, from US-A-5 729 249, a cubic input device is known the 
side surfaces of which have sensitive regions or actuating elements for 

25 manipulating an object displayed on a display device- This known Input device 
Is disadvantageous in that the arrangement and orientation of its actuating 
elements do not correspond to the directions in which the object can be moved 
by the actuating elements or in which the representation can be manipulated. 
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It is the objea of the present invention to provide a control signal input device 
of the type mentioned above, as well as a graphic representation using this 
input device, allowing for a more user-friendly handling. 

To solve the object, the Invention provides a control signal input device for 
a display device, the input device being provided with 

- a housing, 

- three control signal generating devices for generating first control 
signals to the display device, 

- three mutually orthogonal actuating elements, each being supported 
at or In the housing for linear displacement along one of three orthogonal 
spatial axes and projecting outward beyond the housing within at least 
one of two opposite portions of the housing, respectively, each actuating 
element respectively cooperating with a different one of the control 
signal generating devices, and wherein, in dependence on the 
displacement position of the actuating elements, the control signal 
generating devices generate the first control signals for displacement 
of the object on the display device along three directions corresponding 
to the spatial axes of the housing on the display device, and 

- a position detection sensor arrangement provided in or at the housing, 
the position detection arrangement sensing the orientation and/or the 
position of the housing and generating a corresponding control signal 
to the display device for orienting the object on the display device 
according to the orientation and position of the housing. 

In a variant, the present input device comprises 
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- a housing, 

- three control signal generating devices for generating first control 
signals to the display device^ 

- three pairs of actuating elements^ both actuating elements in each 
pair being arranged at different, in particular opposite, portions of the 
housing lying on a respective one of three orthogonal spatial axes 
extending through the housing, each pair of actuating elements 
respectively cooperating with a different one of the control signal 
generating devices, and wheretn, in dependence on the actuating 
condition (e.g., actuating tirne and/or actuating pressure) of the 
actuating elements, the tontrol signal generating devices generate 
the first control signals for displacement of the object on the display 
device along three directions corresponding to the spatial axes of the 
housing on the display device, and 

- a position detection sensor arrangement provided in or at the housing, 
the position detection arrangement sensing the orientation and/or the 
position of the housing and generating a corresponding control signal 
to the display device for orienting the object on the display device 
according to the orientation and position of the housing. 

A display system of the present invention comprises 

- a display device and 

- an input device for generating control signals for displacing and/or 
orienting and/or positioning the object to be represented and/or 
displacing the sectional views along the axes, the input device being 
configured according to one of the previously described variants. 
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In the present Input device, actuating elements, which when actuated generate 
first control signals for controlling the display device, are arranged on the 
three mutually orthogonal spatial axes extending through the housing. These 
actuating elements project from the housing at at least three locations, 
5 preferably at six locations. These actuating elements are either linear 
displacement elements such as rods or the like, or actuating element pairs 
such as feelers/key switches located in pairs within opposite portions of the 
houses on the three orthogonal axes. Such a control signal input device is 
H particularly useful for three-dimensionally Influencing a stereographic 
Sf) representation on a display or for controlling a perspective representation 
on a display along three axes corresponding to the perspective or for displacing, 
,|:: positioning or orienting an object to be represented on the display. 
;L "Displacement of the object'' should be understood In a broad sense In the 
4S context of this invention. Generally, It refers to a manipulation of the object 
Jis representation in the direction of the three spatial axes. For example, the 
O pnesent Input device allows to comfortably "^pass" through bodies displayed 
on the display device along three axes so as to have, e *g., the different sectional 
views along the three axes displayed. In the present case, the sectional views 
are the object and are '^displaced" wheh passing through the body. This may 
20 be advantageous, for example, in the field of medicine and In planning surgery 
so as to pass through a body part such as the head along several axes, thereby 
making if'transparenfto the doctor or surgeon. A further alternative of the 
""displacement of the object'' is moving the object within Its environment 
represented on the display device, 

25 

Ttie exact positional orientation of the input device relative to the representation 
on the display such that the three axes on which the actuating elements of 
the input device are located correspond to the three axes of the representation 
on the display. Is realized in the present invention by providing the Input device, 
30 e.g., with an inertia position and orientation detector arrangement or an 
orientation and/or position detector arrangement. Such a sensor arrangement 


sent By: BSKB; 2058050; Apn-30-01 3:36Py; 


Page 6 


should be sensitive about the three spatial axes. One additional such sensor 
thus guarantees that the change of representation on the display expected 
by the user can actually take place according to the pivoting of the input device. 
Through this sensor, the input devJce is quasi coupled to the representation 
5 on the display or vice versa. 

The advantage of the present input device is the simplicity of the control of 
n the representation on the display device. Due to the automatic poslttonaily 

exact orientation of the input device with the representation (object) on the 
gio display, the actuation of the actuating elements corresponds to a corresponding 
fj change In the representation (object) on the display. Through the coupling 
M of the orientation of the input device and the represented object, the 

arrangement of the actuating elements at orin ttie housing of the inputdevice 
O corresponds to the axes along or about which the representation can be 
J;l5 manipulated (e.g- displacement of the sectional planes of an object or 
C displacement of the object itself along three orthogonal axes). 

The principal idea of the invention is to provide the user with an input device 
representing a three-dimensional coordinate system. In the simplest form, 

20 the input device Is a housing through which three orthogonal three displaccable, 
and possibly rotatable, rods extend that representthe three coordinate axes. 
By means of a position detector arrangement integrated in the input device, 
a coordinate system of a three-dimensional application is always maintained 
synchronous with the orientation of the input device. Thus, a displacement 

25 or rotation of the rods results in a displacement or rotation of a graphic object 
in the corresponding direction. When the Input device is held such that the 
zaxis points upward, for example, the graphic object is also represented with 
itszaxis pointing upward. When the rod corresponding to the zaxis is pushed 
downward, the graphical object also moves downward. When the Input device 
30 is turned to the right through 90', the graphical object is also turned to the 
right through 90°, and a displacement of the z axis rod, now pointing to the 
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right, results in a displacement of the graphical object to the left or the right 
This direct relationship between the manipulation of the input device and the 
graphical output resulting therefrom^ makes using the Input device very easy 
and Intuitively comprehensible for the user, 

5 

In an advantageous development of the Invention, 5t is further provided that 
the housing has a parallelepiped shape, in particular a cubic shape, with six 
side walls and that the actuating elements; when supported at or in the housing 
for linear displacement^, extend from all side walls, the ends of each actuating 
WO element projecting from two opposite parallel side walls of the housing. When 
three pairs of actuating elements^ such as three pairs of key switches, are 
+ provided, these actuating elements are located at all side walls of the cubic 
p housing. As an alternative, the housing may be spherical. It is also conceivable 
f^l to give the housing an outer contour that is the same as the outer contour 
CIS of the object to be represented. For example, the housing has the shape of 
a human head when such a head is represented on the display. The 
arrangement of the actuating elements then corresponds to the possible 
manipulation of the representation of the head on the display. 

20 Through additional actuating elements or by a rotatable or otherwise further 
movable support of the actuating elements, which may also be arranged on 
the linearly displaceable actuating elements, for example, it is possible to 
generate further control signals with the present input device. Additional key 
switches or other switches coutd be used, for example, to realize representation 

25 functions such as scaling the represented body or object or rotating the same . 
Eventually, it is also conceivable that such additional actuating elements can 
be used to realize display functions like a slight tilting of the represented 
sectional plane about an axis. This application may be of interest In structural 
technology or teaching. 


30 
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As a structural embodiment of these additional actuating elements, on e may 
contemplate rockers or knurled wheels besides key switches and other switches. 
Generally speaking, the present input device can be equipped with all of the 
conventional actuating elements known per se from electrical apparatus. 

5 

When using dlsplaceable actuating elements projecting from the housing of 
the input device, such as rods or the like, it Is advantageous In terms of 
Q comfortable use when the rods are centered and are automatically returned 
J1 to this centered position (e.g, by restoring springs) when they have been 
Ip deflected (displaced) from this rest position. By moving the ends of the rods 
u more or less into the housing, the speed of the change of the representation 
^1: on the display can be controlled. This control function is the same with actuating 
g elements formed as key switches where the speed of the change of the 

representation Is controlled through the actuation time, 

W5 

S The following is a detailed description of the invention with reference to the 
drawing. In the figures 

Fig. 1 illustrates a first embodiment of a display control Input device, 

20 and 

F]g, 2 Illustrates a second embodiment of an input device. 

Fig- 1 illustrates a display device 10 in the form of a monitor, the screen 12 
25 thereof displaying a body 14. Upon Input of the corresponding control 
instructions by the user, the body 14 can be passed through along the y 
and z axes. In other words^ sectional views through the body 14 can be 
represented that ly In the planes 16, 18 and 20. 

30 The required control signals are inputted via an input device 22 with a cube- 
shaped housing 24. Accordingly, the housing 24 has three pairs of parallel 
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side walls 26, 28, 30. Three rods 32, 34, 36 extend through the housing 24 
that are orthogonal with respect to each other and protrude from the side 
surfaces 26, 28, 30 with their ends. The rods 32, 34, 35 are supported at 
the housing 24 for linear displacement; depending on the displaced position, 
5 control signals are generated In signal generating devices 38, 40, 42 associated 
with the rods, which, in the present case, serve to displace the sectional planes 
16, 18, 20 via the drive device 44 of the display device 10. A position and 
orientation sensor 46 detects the position and orientation of the input device 
] 22. The output signal of this optical, acoustic or electromagnetic sensor 46 
h is also used to control the representation on the display device 10 through 
^ the drive device 44. As a consequence, the coordinate system of the 
t representation on the display device 10 turns with the orientation of the rods 
32, 34, 36 of the input device 22 In space (Input device coordinate system). 

i 5 Further functions of the representation, such as the displacement of the object 
14 along the three axes of the coordinate system of the representation, can 
' be realized through additional actuating elements 48 located at the housing 
24. Through these actuating elements 28, a fine tuning of the position of the 
respective plane and/or a slight indinatton of the representation of the sectional 
20 plane about a respective one of the three axes may be effected and/ or the 
representation may be scaled. Through another of these additional actuating 
elements 48, the above mentioned "coupling" of the Input device 22 with the 
representation on th display 12 can selectively be Interrupted or restored, 
for example. Thus, It is possible, similar to taking a mouse from a pad and 
25 placing th© mouse on another location, to displace the body 14 on the screen 
by reciprocating the Input device 22 several times. The rotation of the artuatlng 
elements 32, 34, 36 may be used, e.g., for the linear fine positioning of the 
planes 16, 18, 20. 
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Eventuaily, the rods 32, 34, 36 are supported for rotation about their 
longitudinal axis so as to aiiow fro further display or movement functions of 
the object on the screen 12 that can be controlled via the input device 22. 

5 Fig, 2 illustrates an alternative embodiment of an input device 22V wherein 
similar parts of the input device 22' have been given the same reference 
numerals as in Fig, 1- The input device 22' differs from the Input device 22 
□ of Fig, 1 in that it ftjrther comprises rotatably supported rotary actuating 
elements formed as turn knobs 50, 52, 54 or tum sleeves and concentrically 
010 arranged about the rods 32, 34, 36, The rotation of the turn knobs SO, 52, 
2 54 is detected In the units 56, 58, 60 and converted into drive signals for 
influencing the movement and/or the representation of the object^ in particular 
; the rotation of the object. Due to the separate rotary elements, the rotation 

O of a graphical object can be entirely separated from the displacement, which 

iJjlS may be desirable. With rotatable rods, a displacement of the rod most often 
C also results in a slight rotation of the rod. This is no problem when the rotation 

of the rods Is used, e,g,^ for a fine adjustment of the displacement. 

Moreover, the input device 22* has a means 62 for manipulating the movement 
20 of the rods 32, 34, 36 and the turn knobs 50, 52, 54. This means 62 is 
controlled or activated depending on the position of the object on the screen 
12, When the object is moved against an obstacle while actuating the rods 
32, 34, 36, for example, the means 62 prevents a tlirther movement of the 
respective rod or rods and turn knob or knobs. Thus> the representation on 
25 the screen is coupled with the freedom of movement of the rods 32, 34, 36 
and the turn knobs 50, 52, 54. The means 62 may comprise drive means, 
e.g. stepper motors, cinemaWcally coupled to the rods and tum knobs. While 
the braking device prevents further movement of the rods 32, 34, 36 and 
the turn knobs 50, 52, 54, the drive means is able to move the the rods 32, 
30 34, 36 and the turn knobs 50, 52, 54 (back) when this Is possible and desired 
for the given type of representation on the display. 
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It should be noted that an active movement and/or blocking of the rod-shaped 
actuating elements 32^ 34, 26 In dependence on the position of the object 
within its environment represented on the display device can be realized 
independent of the presence of the position detector arrangement and, 
5 therefore, justifies legal protection by Itself within the scope of the present 
invention. 


5ent By: BSKB; 


2058050; 


Apr-30-01 3:37PMj 


Page 12 


11 

Claims 

1 , An input device for control signals for controlling the movement of an 
object represented on a display device, comprising 

- a housing (24), 

- three control signal generating devices (38, 40, 42) for generating 
first control signals to the display device, 

- three mutually orthogonal actuating elements (32, 34* 36), each 
being supported at or in the housing (24) for linear displacement 
along one of three orthogonal spatial axes (x, y, z) and projecting 
outward beyond the housing (24) within at least one of two opposite 
portions of the housing (24)^ respectively, each actuating element 
(32, 34, 36) respectively cooperating with a different one of the 
control signal generating devices (38^ 40, 42), and wherein, in 
dependence on the displacement position of the actuating elements 
(32, 34, 36), the control signal generating devices (38, 40, 42) 
generate the first control signals for displacement of the object 
on the display device along three directions corresponding to the 
spatial axes of the housing (24) on the display device, and 

- a position detection sensor arrangement (46) provided In or at 
the housing (24), the position detection arrangement (46) sensing 
the orientation and/or the position of the housing (24) and 
generating a corresponding control signal to the display device 
for orienting the object on the display device according to the 
orientation and position of the housing (24). 
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2. The input device of claim 1, wherein the actuating elements (32, 34, 
36) are supported in or at the housing (24) around a rest position^ 
in particular centered about a rest position, and automatically move 
back into the rest position upon displacement from the same. 

The Input device of claim 2, wherein, only upon a displacement from 
the rest position, will the control signal generating devices (38, 40, 
42) generate control signals In dependence on the direction and/or 
degree of displacement. 

An input device for control signals for controlling the movement of 
an object represented on a display device^ comprising 

- a housing (24), 

- three control signal generating devices (38, 40, 42) for generating 
first control signals to the display device, 

' three pairs of actuating elements, both actuating elements in each 
pair being arranged at different, in particular opposite, portions 
of the housing lying on a respective one of three orthogonal spatial 
axes extending through the housing each pair of actuating elements 
respectively cooperating with a different one of the control signal 
generating devices, and wherein, in dependence on the actuating 
condition (e.g., actuating time and/or actuating pressure) of the 
actuating elements, the control signal generating devices generate 
the first control signals for displacement of the object on the display 
device along three directions corresponding to the spatial axes 
of the housing on the display device, and 
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9 position detection sensor arrangement provided in or at the 
housing, the position detection arrangement sensing the orientation 
and/or the position of the housing and generating a corresponding 
control signal to the display device for orienting the object on the 
display device according to the orientatiori and position of the 
housing. 

The Input device of one of claims 1 to 4, wherein the actuating elements 
(32, 34, 26) are supported ator In the housing (24) for rotation about 
their axes {x, y, z) extending in the respective direction of displacement 
and wherein the control signal generating devices (38, 40, 42) generate 
second control signals to the display device (10) in dependence on 
the rotational positions of the actuating elements (32^ 34, 26). 

The input device of one of claims 1 to 5, wherein a rotary actuating 
element (50, 52, 54) is provided per actuating element (32, 34, 36), 
which is rotatable around the axis of the associated actuating element 
(32, 34, 26) extending in the direction of displacement (x; y; z) and 
wherein the control signal generating devices (38, 40, 42) or additional 
control signal generating devices (56, 58, 60) generate second control 
signals to the display device (10) in dependence on the rotational 
position of the rotary actuating elements (50, 52, 54). 

7. The input device of claim 6, wherein the actuating elements (32, 34, 
36) penetrate the rotary actuating elements (50, 52, 54). 

8. The input device of one of claims 1 to 7, wherein at or in the housing 
(24), switches or key. switches or other actuating elements (48) are 
arranged for providing further control signals to the display device 
(10), 
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9. The input device of one of claims 1 toS, wherein, per actuating element 
(32, 34^ 36) and - if provided - per rotary actuating element (50, 52^ 
54), one means (62) for preventing further displacement or turning, 
the means being controllable by the display device in dependence oa 
the position an object represented on the display device is in within 
an environment also represented on the display device. 

10. The input device of claim 9, wherein the preventing means (62) 
comprises a mechanical braking/blocking device for blocking the 
respective actuating element (32, 34, 36) and/or the rotary element 
(50, 52^ 54), or a drive means for moving or turning the actuating 
element (32, 34, 36) and/or the rotary actuating element (50, 52, 
54). 

11. The input device of one of claims 1 to 10, wherein the housing (24) 
has the shape of a parallelepiped^ in particulars cube, and the actuating 
elements (32, 34, 36) protrude from all side walls (26, 28, 30) of the 
housing (24) or are arranged on all side walls (26, 28, 30) of the housing 

(24). 

12. The input device of one of claims 1 to 11, wherein the housing Is 
spherical In shape and the actuating elements are protrude from or 
are arranged in substantially diametrically opposite regions. 

13. The input device of one of claims 1 to 12, wherein the housing 
substantially corresponds to the outer contour of an object to be 
displayed on the display device and the actuating elements are arranged 
corresponding to the axes along which the object may be controlled 
in its representation. 
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14, A display system for representing sectional views of an object that 
are adapted to be displaced along orthogonal axes^ comprising 

- a display device (10) and 

an input device (22) for generating control signals for displacing 
and/or orienting and/or positioning the object to be represented 
and/or displacing the sectional views along the axes (x,y,z), the 
input device (22) being configured according to one of the previous 
claims* 


ent By: BSKB- 


2058050; 


Apr-30-01 3:38PM; 


Page 17/17 


16 


Abstract 

Input device for control sicinals for controllinQ the movement of an 
object represented on a displav device and graphic disolav having 
said input device 

An input device for control signals for controlling the movement of an object 
represented on a display device comprises a housing (24) and three control 
signal generating devices (38, 40, 42) for generating first control signals. 
Further, it has three mutually orthogonal actuating elements(32, 34. 35), 
each being supported at or in the housing (24) for linear displacement along 
one of three orthogonal spatial axes (x, y, 2) and projecting outward beyond 
the housing (24) withfn at least one of two opposite portions of the housing 
(24), respectively- Each actuating element (32, 34, 36) respectively cooperates 
with a different one of the control signal generating devices (38, 40, 42), and 
wherein, in dependence on the displacement position of the artuating elements 
(32, 34, 36), the control signal generating devices (38, 40, 42) generate the 
first control signals. Through a position detection sensor arrangement (46), 
the orientation and/or the position of the housing (24) Is detected and the 
object is oriented on the display device according to the orientation and position 
of the housing (24). 


(Fig. 1) 
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I acknowledge the duty to file, in this application or patent, notification of any change in status resulting in loss of 
entitlement to small entity status prior to paying, or at the time of paying, the earliest of the issue fee or any 
maintenance fee due after the date on which status as a small entity is no longer appropriate. (37CFR 1, 28(b)) 

I hereby declare that I understand the English language. 

I hereby declare that all statements made herein of my own knowledge are tme and that all statenients made on 
infomiation and belief are believed Co be tme; and further that these statements were made with die knowledge that 
willful false statements and the like so made are punishable by fine or imprisonment, or both, under section 100] of 
Title IS of the United States Code, and that such willful false statements may jeopardize die validity of &e 
application, any patent issuing thereon* or any patent to which this verified statement is ditticted, 

NAME OF PERSON SIGNIN G P[0<; Dr. D. Tsichntzis Dr. H.-G. Sundennann 

TTILE IN ORGANIZATIO N Chaifman ^^J^^ p^^^cuftve Board Viqgchainnan ot the Execu tive Board 

ADDRESS OF PERSON SIGNING Haup^rg^^2Q2a, 55639 KQnigswinter fi^fTW&^aqfn 1, 55>^Wachfcerg 


SIGNATURE . ^^AK^ 



